17207-00003 
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METHODS AND SYSTEMS FOR ANALYZING 
MARKETrNG CAMPAIGNS 

BACKGROUND OF THE INVENTION 

This invention relates generally to marketing and, more particularly, to 
methods and systems for identifying and marketing to segments of potential 
customers. 

Typical marketing strategies involve selecting a particular group based 
5 on demographics or other characteristics, and directing the marketing effort to that 
group. Known methods typically do not provide for proactive and effective consumer 
relationship management or segmentation of the consumer group to increase 
efficiency and returns on the marketing campaign. For example, when a mass mailing 
. :,3 campaign is used, the information used to set up the campaign is not segmented 

' "rlO demographically to improve the efficiency of the mailing. The reasons for these 
inefficiencies include the fact that measurement and feedback is a slow manual 
process that is limited in the depth of analysis. Another reason is that data collected 
- 3 from different consumer contact points are not integrated and thus does not allow a 

^ marketing organization a full consumer view. 

LftS Results of this inefficient marketing process include loss of market 

share, increased attrition rate among profitable customers, and slow growth and 
reduction in profits. 

BRIEF SUMMARY OF THE INVENTION 

Methods and systems for analyzing the success of a marketing 
campaign are described. By using campaign results and an original campaign 
20 database the success of a marketing campaign can be determined. The method 
includes the steps of profiling results of the marketing campaign against a list of user 
defined dimensions, the dimensions may be derived using analytic models, and 
assigning a score to the results of the marketing campaign. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram of an exemplary embodiment of a web- 
25 based global modeling architecture; 
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Figure 2 is a block diagram of an exemplary embodiment of a targeting 

engine; 

Figure 3 is an exemplary graphical user interface for pre-selecting 
mailing criteria; 

Figure 4 is an exemplary user interface for the input of marketing 

criteria; 

Figure 5 is an exemplary user interface for selection of structures; 
Figure 6 is an exemplary user interface for selection of campaigns; 
Figure 7 is an exemplary user interface for creation of a selection table; 

and 

Figure 8 is an exemplary user interface for a gains chart. 

DETAILED DESCRIPTION OF THE INVENTION 

Exemplary embodiments of processes and systems for integrating 
targeting information to facilitate identifying potential sale candidates for marketing 
campaigns are described below in detail. In one embodiment, the system is intemet 
based. The exemplary processes and systems combine advanced analytics, On Line 
Analytical Processing (OLAP) and relational data base systems into an infrastructure. 
This infrastructure gives users access to information and automated information 
discovery in order to streamline the planning and execution of marketing programs, 
and enable advanced customer analysis and segmentation of capabilities. 

The processes and systems are not limited to the specific embodiments 
described herein. In addition, components of each process and each system can be 
practiced independent and separate from other components and processes described 
herein. Each component and process can be used in combination with other 
components and processes. 

Figure 1 is a block diagram of an exemplary embodiment of a web- 
based global modeling architecture 10. Data from various international markets 12 is 
compiled in a consumer database 14. Consumer database 14 contains user defined 
information such as age, gender, marital status, income, transaction history, and 
transaction measures. Customer database 14 is accessible by a server 16. Server 16 
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stores the consumer database 14 in a relational database such that the consumer data is 
accessible to a targeting engine (not shown in Figure 1) which takes data input and 
based upon modeling generates user interfaces 18. Architecture 10 may also be 
client/server based. 

5 Figure 2 illustrates a marketing system 20. Included in marketing 

system 20 are a targeting engine 22 and a plurality of data inputs and outputs. Data 
inputs include a customer database 24, selection criteria 26, previous campaign results 
28 and marketing data 30. Targeting engine 22 generates targeting mailing lists 32, 
campaign and data structures 34 and gains charts 36. Historical campaign and data 
10 structures 34 are reusable by targeting engine 22. Targeting engine 22 also generates 
outputs to a user interface 38, typically in a graphic format. Targeting engine 22 
streamlines the planning and execution of marketing programs and enables advanced 
customer analysis and segmentation capabilities. Targeting engine 22 further delivers 
Q information in a proactive and timely manner to enable a user to gain a competitive 

: t5 edge. Targeting engine 22 accomplishes these goals through the use of models. 

in MODELS 

::3 Models are predicted customer profiles based upon historic data. Any 

number of models can be combined as an OLAP cube which takes on the form of a 
fU multi dimensional structure to allow immediate views of dimensions including for 

= |0 example, risk, attrition, and profitability. 

* ^ Models are embedded within targeting engine 22 as scores associated 

with each customer, the scores can be combined to arrive at relevant customer metrics. 
In one embodiment, models used are grouped under two general categories, namely 
marketing and risk. Examples of marketing models include: a net present value / 

25 profitability model, a prospect pool model, a net conversion model, an early 
termination (attrition) model, a response model, a revolver model, a balance transfer 
model, and a reactivation model. A propensity model is used to supply predicted 
answers to questions such as, how likely is this customer to: close out an account 
early, default, or avail themselves to another product (cross-sell). As another 

30 example, profitability models guide a user to optimized marketing campaign 
selections based on criteria selected fi-om the consumer database 24. A payment 
behavior prediction model is included that estimates risk. Other examples of risk 
models are a delinquency and bad debt model, a fraud detection model, a bankruptcy 
model, and a hit and run model. In addition, for business development, a client 
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prospecting model is used. Use of models to leverage consumer information ensxires 
right value propositions are offered to the right consumer at the right time by tailoring 
messages to unique priorities of each customer. 

TARGETING ENGINE 

5 Targeting engine 22 combines the embedded models described above 

to apply a score to each customer's account and create a marketing program to best 
use such marketing resources as mailing, telemarketing, and intemet online by 
allocating resources based on consumer's real value. Targeting engine 22 maintains a 
multi-dimensional customer database based in part on customer demographics. 
10 Examples of such customer related demographics are: age, gender, income, 
profession, marital status, or how long at a specific address. When applied in certain 
countries, that fact that a person is a foreign worker could be relevant. The examples 
'^t listed above are illustrative only and not intended to be exhaustive. Once a person has 
been a customer, other historical demographics can be added to the database, by the 
¥5 sales force, for use in future targeting. For example, what loan products a customer 
: fi has previously purchased is important when it comes to marketing that person a 
product in the future in determining a likelihood of a customer response. To illustrate, 
l'^' if a person has purchased an automobile loan within the last six months, it probably is 

M unreasonable to expend marketing effort to him or her in an automobile financing 

\^ campaign. 

:g However a cash loan or home equity loan may still be of interest to the 

^^3 automobile loan purchaser. In deciding whether to market to him or her, other criteria 

that has been entered into the targeting engine 22 database in the form of a transaction 
database can be examined. The transaction database contains database elements for 

25 tracking performance of previously purchased products, in this case the automobile 
loan. Information tracked contains, for example, how often payments have been 
made, how much was paid, in total and at each payment, any arrears, and the 
percentage of the loan paid. Again the list is illustrative only. Using information of 
this type, targeting engine 22 can generate a profitability analysis by combining 

30 models to determine a probability score for response, attrition and risk. Customers are 
rank ordered by probability of cross-sell response, attrition, risk, and net present 
value.. For example, if a consumer pays a loan off within a short time, that loan 
product was not very profitable. The same can be said of a product that is constantly 
in arrears. The effort expended in collection efforts tends to reduce profitability. 
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When a marketer embarks on a campaign, they will input into targeting 
engine the desired size of the campaign. Using 60,000 as an example, the marketer 
inputs the target consumer selection criteria 26, some subset of the demographics 
listed above, into targeting engine 22. 

5 Targeting engine uses the stored databases and generates a potential 

customer list based on scores based on demographics and the propensity to buy 
another loan product and expected profitability. Customers can be targeted by the 
particular sales office, dealers, product type, and demographic profile. Targeting 
engine enables a user to manipulate and derive scores from the information stored 
10 within the consumer and structure databases. These scores are used to rank order 
candidate accoimts for marketing campaigns based upon model scores embedded 
within the consumer and structure databases and are used in a campaign selection. 
Scores are generated with a weight accorded the factors, those factors being the 
demographics and the models used. Using the scores and profitability targeting 
If engine generates a list of potential profitable accounts, per customer and / or per 
^ J product, in a rank ordering from a maximum profit to a zero profit versus cost. 

y As candidate accounts are ranked by a selected model score, targeting 

engine 22 (shown in Figure 2) performs calculations at which marginal retums 
M become zero, and the user is alerted to an optimal mailing depth which can override 
jip initial manually selected campaign size to form a marketing campaign customer list. 
= 2 The selected marketing campaign results in a database table which has the customer 
u identification number, relevant model scores, flags that indicate whether the customer 
^~ is a targeted or a random selection, and an indicator for the product offered. As 
shovra in Figure 7, a user can use a user interface 80 to choose a particular database 
25 table. As an example, targeting engine 22 may determine that a mailing of 40,000 
units, as opposed to the requested 60,000 imits, is the maximum profitable for the 
example campaign. Conversely, targeting engine 22 may also determine that, for the 
requested campaign, 100,000 units have profit potential and will flag that information 
to the marketer. To arrive at expected profitability numbers, targeting engine 22, has 
30 the capability to deduct costs, such as mailing cost, from a proposed campaign. 

GRAPHICAL USER INTERFACE 

Users input the target consumer selection criteria 26 into targeting 
engine 22 through a simple graphical user interface 38. An exemplary example of a 
graphical user interface is shown in Figure 3. In this exemplary example, one of the 
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options available to a user is to input pre-selection criteria for a mailing campaign 40. 
Once the user selects the mailing pre-selection criteria 40 option, another user 
interface 50, one possible example is Figure 4, allows the user to input the marketing 
criteria. Example marketing criteria shown are age 52, credit line 54, a profession 
code 56, and a plurality of risk factors 58. 

Once a user has input the marketing campaign pre-selection criteria 
into targeting engine, that criteria is retained by a targeting engine database. Details 
of all available criteria are retained as entries in a database table and duplication of 
previous efforts is avoided. 

Marketing campaigns can be stored within targeting engine 22. An 
exemplary example showing a graphical interface 60 used to choose previous 
marketing campaigns is shown in Figure 5. In this example, a user can choose 
between Campaign 1 62 and Campaign2 64. Figure 6 is a user interface 70 showing 
structures associated with Campaign2 64. Structure 1 72 indicates that analysis of the 
campaign based on age, gender, credit line and the targeting model is available. Users 
can build new structures on an ad-hoc basis by choosing the Create New Structure 74 
on user interface 70. By stacking structures of different campaigns in chronological 
order trends within segments can be discemed. As a result of the storage of marketing 
campaign structures within targeting engine database, those structures having time as 
one of the database elements allow a user to define trends whereby a marketing 
campaign history structure which is automatically analyzed by targeting engine 22. 

TREND ANALYSIS 

A trend analysis is a way to look at multiple marketing campaigns over 
time and is also a way to evaluate the models used and define trends. As an example 
of trend analysis, the user can determine where a response rate has been changing or 
where profitability has been changing or look at the number of accoimts being closed. 
A user can also analyze particular population segments over time. 

Trend analysis can be used to track how a particular segment, males 
from age 25 - 35 with an auto loan for example, may change in a propensity to avail 
themselves to other loan products over time. 
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A user can create marketing test cells in the targeted accounts. Test 
cells are created using a range of selection criteria and random assignments. Accounts 
satisfying selection criteria are counted. A marketing cell code for each account is 
assigned in the campaign table. The user can then output the contents of the campaign 
table to a file that can be exported to print a campaign mailing. 

A user can profile selected accounts and assign a score for any 
campaign against a list of user defined dimensions. Assigning a score allows results 
to be rank ordered. Profiling shows how targeted accounts differ from non-selected 
accounts and is used to ensure the campaign is reaching the target base of the 
campaign. Profiling dimensions are selected during the initial customization process. 
Profiling can be done directly on a portfolio without any reference to marketing 
campaigns. 

Targeting engine 22 also accepts marketing campaign results based 
upon each customer. Additional information can be appended onto the marketing 
campaign result files that become part of the consumer database. Exemplary 
examples of information that is added to the marketing campaign result files are: loan 
size, loan terms, and risk score. Campaign analysis is done by comparing the original 
marketing campaign customer list against marketing campaign results. Targeting 
engine 22 then profiles this comparison information to construct gains charts. 

Maintaining feedback into targeting engine 22 improves subsequent 
modeling cycles. In the 60,000 example campaign explained previously, assume the 
size of the actual campaign after targeting engine applied a model was 40,000 
mailings. Information regarding who responded and how much was lent, for example, 
is input into targeting engine. Analysis facilitates a determination of how good the 
model performed when it told the marketer 40,000 mailings was the optimal campaign 
size. Analysis is accomplished in one embodiment by the use of gains charts. As an 
example, the gains charts for the 40,000 mailings campaign may indicate that a 
mailing to 10% of the group may actually obtain 20% of all potential responders. 

An exemplary gains chart is displayed on the user interface 90 shown 
in Figure 8. As shown in Figure 8, when models are used to generate prospective 
customers for a marketing campaign, a larger number of responses per campaign size 
is generated, thereby increasing the efficiency of the marketing campaign and 
identifying risks such as delinquency and fi-aud. A gains chart approach allows a user 
to track performance of models used over several marketing campaigns and therefore 
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allows a user to show where the model works best and where the performance of the 
model need to be addressed. 

Scores for customer accounts are generated as a part of a campaign 
analysis. Models are used to assign a score to an account as a result of a completed 
5 campaign. 

While the invention has been described in terms of various specific 
embodiments, those skilled in the art will recognize that the invention can be practiced 
with modification within the spirit and scope of the claims. For example, although the 
above embodiments have been described in terms of a mailing campaign, the methods 
10 and systems described above are applicable to internet E-mail based campaigns and 
telemarketing campaigns. 
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